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Abstract. We consider quadratic stochastic operators, which are sep- 
arable as a product of two linear operators. Depending on properties of 
these linear operators we classify the set of the separable quadratic sto- 
chastic operators: first class of constant operators, second class of linear 
and third class of nonlinear (separable) quadratic stochastic operators. 
Since the properties of operators from the first and second classes are 
well-known, we mainly study properties of the operators of the third 
class. We describe some Lyapunov functions of the operators and apply 
them to study w-limit sets of the trajectories generated by the opera- 
tors. Also we compare our results with known results of the theory of 
quadratic operators and give some open problems. 



1. Introduction 

The history of the quadratic stochastic operators can be traced back to 
work of S.Bernshtein[lj. During more than 85 years this theory developed 
and many papers were published (see e.g. pQ-[9], |12j-|14j). In recent years 
it has again become of interest in connection with numerous applications to 
many branches of mathematics, biology and physics. 

A quadratic stochastic operator (QSO) has meaning of a population evo- 
lution operator, which arises as follows: Consider a population consisting of 
m species. Let x° = {x\, ...,x^J be the probability distribution of species in 
the initial generations, and Pij± the probability that individuals in the ith 
and jth species interbreed to produce an individual k. Then the probability 
distribution x' = (x^, x' m ) of the species in the first generation can be 
found by the total probability i.e. 



(1.1) — 'y * Pij^XiXj, k — 1, 



771 



where the cubic matrix P = P{V) = k=i satisfying the following 

conditions 



(1.2) Pij,k>0, £% = 1, y'6{l,..,m}. 

k=l 
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This means that the association x° — > x' defines a map V of the simplex 

m 

(1.3) S™" 1 = {x = (x x , x m ) £l m : > 0, x % = 1} 

i=i 

into itself, called the evolution operator. Note that each element x £ S" 71--1 
is a probability distribution on E = {1, 

The population evolves by starting from an arbitrary state x^ 1 , then passing 
to the state x' = V(x^), then to the state x" = V(V"(x^)),and so on. 
For a given x^ S S m_1 , the trajectory {x( m ) | m = 0, 1, ...} induced by the 
QSO CEO) is defined by 

x (m+i) = ^( X M), where m = 0,1, ... 

One of the main problems in mathematical biology is to study the asymptotic 
behavior of the trajectories. This problem was solved completely for the 
Volterra QSO's (see [5], [6], [7]) defined by the relations ([LT]) . ([L2]) , and by 
the additional assumption 

(1.4) P iijfc = 0for k£{i,j}. 

The biology meaning of relation (jl.2p is obvious: every individual repeats 
the genotype of one of its parents. For the Volterra QSO the general formula 
was given in [5], 

m 

(1.5) x' k = x k (l + ^2a ki Xi), 

i=l 

where a k i = ^Pik,k ~ 1 f° r i 7^ k and a k k = 0- Moreover, a k i = —aik an d 
\a>ki\ < 1- 

In [51 [8], the theory of QSO (|1.5p was developed using theory of the Lya- 
punov functions and tournaments. But non- Volterra QSOs (which does not 
satisfy the condition (jl.4p ) were not completely studied. Because there is 
no general theory that can be applied for study of non- Volterra operators. 

Each quadratic operator V can be uniquely defined by the cubic matrix 

P = P(V) = {I'.jjATjJ, : 

satisfying the conditions (|1.2p . A constructive description of P was given 
in [3], [3]. This construction depends on the probability measure \x which is 
given on a fixed graph G. In |4j , it is proved that the QSO resulting from this 
construction is of Volterra type if and only if the graph G is connected. A 
construction of QSOs involving a general finite graph and probability mea- 
sure (i (here \x is the product of measures defined on maximal subgraphs of 
the graph G) and yielding a class of non- Volterra operator was described in 
|14j . It was shown that if \i is given as the product of probability measures, 
then the corresponding non- Volterra operator can be studied by N Volterra 
operators (where iV is the number of connected components of the graph). 
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In this paper we consider QSO (|l.ip . (jl.2p with additional condition 

(1.6) P ijtk = a ik bjk, for all k G E 

where a^, bj k 6 K entries of matrices A = (a^) and B = (bjk) such that the 
conditions (|1.2p are satisfied for the coefficients (|l,6p . 

Then the QSO V corresponding to the coefficients (jl.6p has the form 

(1.7) 4 = {V(x)) k = (A{x)) k ■ (B(x)) k , 
where (A(x)) k = YT=i a ik x i, i B {x))k = YJT=i bjkXj. 



Definition 1.1. The QSO (fL 7| ) is called separable quadratic stochastic op- 
erator (SQSO). 



Remark 1.2. 1. If A (or B) is the identity matrix then the operator (1.7 ) 
becomes a linear Volterra QSO. 

2. The following example shows that the condition M.6\) is sufficient for a 
QSO to be product of two linear operators, but the condition is not necessary: 
consider matrices 



A 





1 


o\ 






1 




i 










i 


2 


• 







1 J 




V o 


2 





Then corresponding QSO is 



x' 2 = x\{x\ + 2x 2 + 2x 3 ) 
^3 = x 3 (2x 2 + x 3 ) 

For this operator we can take Pi3,2 = ^31,2 = 1 but from matrices A and 
B we have 032612 = / P3i,2- But one can easily check that a QSO with 
coefficients P%^ k can be written as the product of two linear operators A = 
iflik) and B = (bj k ) if and only if 

(1.8) P ijtk + P ji:k = a ik b jk + a jk b ik for any i,j, k € E. 

Thus the condition (CQ|) is a particular case of $1.8\) . In this paper for 
simplicity we assume that M.6\) holds. 

The paper is organized as follows. In section 2 we classify the set of 
the SQSOs as constant operators, linear and nonlinear operators. Since the 
theory of linear operators is well-known, we mainly study properties of the 
nonlinear SQSOs. Section 3 is devoted to describe some Lyapunov functions 
of such nonlinear operators. In section 4 we apply the Lyapunov functions to 
obtain upper estimates for the set of w-limit points of trajectories generated 
by SQSOs. In the last section we compar our results with known results of 
QSOs and give some open problems. 
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2. Classification of SQSO's 

From the conditions P%j k — an< i Sfc=i Pij,k = 1 f° r an hJ it follows the 
condition on matrices A and B that a^bj^ > 0, AB r = 1, where B T is the 
transpose of B and 1 is the matrix with all entries l's. If = (an, dim) 
is the i-th row of the matrix A and 6^') = (ft ■ 1) ft, m ) is the j-th row of the 
matrix 5, then from AB T = 1 we get 

(2.1) a®b® = l, for alH,j = l,...,m, 
For a fixed j, the above condition implies that 

(2.2) ^')) T = (M,.,1). 

If det(^) + 0, then (JH^D gives &C?) = &W for all fe,j = l,..,m, i.e., all 
rows of B are the same, therefore det(-B) = 0. Similarly, if det(B) ^ 0, then 
all the rows of A must be the same, so det(A) = 0. 

But in spite of both A and B have zero determinant we may have the 
matrices A and B are without all identical rows. 

Remark 2.1. If m = 2 and det(A) = satisfying the condition \2.1\) then 
one can check that A has the identical rows. But for m > 3, from det(A) = 
and the condition 112.1]) . we may have A and B having not all the same rows. 
For example, consider 



b 


2/1 


1 


-yi) 




( o 


1 




b 


V'2 


1 









1 


i) 


b 


2/3 


1 


-2/3 J 




\ 2b 


1 

2 





where b > 0, yi G [0, 1] for all i = 1,2, 3. It is easy to see that these matrices 
satisfy the condition $2.1]) and det(A) = det(-B) = 0. 

So we have three cases for the SQSO (| 1 . T|) : 

Case 1: If det(A) = det(B) = and both of them have the identical 
rows, then the SQSO becomes constant i.e 

(2.3) x' k = ai k b lk , for k = 1, ...,m. 

In this case the dynamical system is trivial: independently on initial 
point x^ ' = x° E S m ~ l all trajectories coincide with {x^} such that 

x[ n) = aikhk, for k = l,...,m, n=l,2, ... 

Case 2: If det(j4) ^ 0, then B has the same rows and SQSO becomes 

m 

(2.4) x' k = h k } y ajkXj, for k = l,...,m. 

i=l 

which is a linear stochastic operator. 
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Remark 2.2. 1. Since B can be uniquely determined by a given A with 
&et{A) ^ 0, the operator (2.1$ depends on A only. Moreover, the matrix 
P = (frifcO«fc)rA:=i i s a Quadratic stochastic matrix. 

2. It is known (see e.g [15] ) that the properties of homogeneous Markov 
chains with the phase space E = {l,...,m} can by completely determined 
by the initial distribution x € S m ~ 1 and the stochastic matrix P i.e. the 
dynamical system generated by the operator {2.1$ . The theory of such dy- 
namical systems is known (see for example [lljj. Also for the dynamical 
behavior of general linear operators R m — > R m see, for example, [2\, pages 
159-181. 

Case 3: If det(A) = det(B) = but both of them don't have all the 
identical rows, then the SQSO is 

(m \ / m \ 

y~] aikXj J ^ bjkXj , for k = l,...,m. 

Remark 2.3. 1. Since B can not be uniquely determined by a given A with 
det(.A) = 0, the operator (2. 5]) depends on both matrices A and B. 

2. By the above mentioned reasons only SQSO (2.5]) is interesting to 
study. In this case, we can have a rich theory of such operators: to find Ly- 
punov functions; to study fixed points; to determine concepts of tournaments 
and so on. So the sequel of this paper is devoted to SQSO (2.5)) . 

3. Lypunov Functions of SQSO (12.50 

Let G S™' 1 be the initial point, and let {x^ ,x (1 \x^ , ...} be the 
trajectory of the point x^°\ Denote by uj(x^) the set of limit points of the 
trajectory {x^}^ =0 . Since {x^}^ =0 C S' m ~ l and S m ~ l is a compact set, 
it follows that uo{x^) ^ 0. If uj(x^) consists of a single point, then the 
trajectory converges, and uj(x^) is a fixed point of the operator V. 

Definition 3.1. A continuous functional <fi : S" 1 ^ 1 — > R is called a Lya- 
punov function for the dynamical system (2. 5\) if the limit lirrin^oo 4>{x^) 
exists for any initial point x^ G S m ~ l . 

Obviously, if lirn n _»oo 4>{x^ n ') = c, theno;(x ) C </> _1 (c). Consequently, for 
an upper estimate of uj(x°) we should construct a set of Lyapunov functions 
that is as large as possible. 

Denote 

A = {(A, B) : det(A) = det(-B) = 0, AB T = 1, and 
both matrices don't have all the identical rows}. 
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Theorem 3.2. For the dynamical system \2. 5|) . the junction V> c : S m ~ l — > R 
defined by 

m 

(3.1) ^cfc) = ^ cfc^fc 

fe=i 

is a Lypunov function if c = (c±, c m ) T satisfies Q > /or all 1 < i < m 
and either Ac < Ic or < ic where A = (ajj), i? = (&«), wrai/i < 
a>ij,bij < 1 /or 1 < i,j < m ; (A, B) € .A and / is the identity matrix of 
order m. 

Proof. Suppose Ac < Ic, then we have 



k=l k=l «,i=l 

m m m m 

fc=l «,i=i fc=l i=l 




»i < CiXi = ip c (x) 



as < b{j < 1. 



Thus, for any n, we have ^) c {x^) < ■0 c (x( n ~ 1 )) and c < Vc^" - ' 1 ) < c, 
with c = minjCj, c = maxjCj. Consequently, the sequence {ip c (x ( - n ^)}'^ ) =0 is 
convergent. Therefore, tp c (x) = Ylk"=i °k x k is a Lyapunov function for the 
dynamical system (|2.5p . □ 



Corollary 3.3. T/ie function defined by 

m / m \Pk 

(3.2) </>(*) = Yl [J2*kXi) 

k=l \i=l J 

is a Lyapunov function for the dynamical system \2. 5\) for any € M + if 
c (k) — (cm, Cfc2, Ckm) satisfies Cij > 0, for all i,j = l,...,m and either 
Ac( k ' < c( k > or Bc( k ' < c^ for all k = l,...,m, where A = (ay) and 
B = (bij), (A, B) € A with < Oy, bij < 1 for all 1 < i, j < m. 

Remark 3.4. To use Theorem \3.2\ one has to find non-zero solution (if 
exists) of the system of inequalities Ac < Ic (or Be < Ic). It is known (see 
[10] . page J^2) that the set C of all solutions of the system of inequalities is 
a polyhedral convex cone: if c is in C, then the vector tc for all t > ("the 
ray or halfline generated by c) are also in C. Such a polyhedral convex cone 
{c : (A — I)c < 0} can also be expressed as the convex-cone hull Q < of a 
finite set Q = {Qi, Q q } : 

Q < = {c : c = viQi + ... + v q Q q , Vi > 0} = {c : c = Qv, v > 0}. 
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Concretely, Q is the m by q matrix with Q\, ...,Q q as columns. For a method 
of solving of the system of linear inequalities see [H] . 

Now we shall give some solutions of the above mentioned system of in- 
equalities. 

Proposition 3.5. // 

m 

(3.3) dj = ^~]ajk < 1; for all i = l,...,m, 

k=l 

then the system of inequalities Ac < Ic has nonzero solutions 
c(t) = (tc\,tc2, ...,tc m ) with Ci = Oj for all t > 0. 

Proof. By Remark 13.41 it is enough to prove for c(l) i.e t = 1: 

m m m 

^ «ifcCfc = OikOk < a ik = a i = °i- 



fc=l fc=l fe=l 



□ 



The following example shows that the above condition (]3.3p is not neces- 
sary: 

Example. Consider 

8-36i 





( 1 









/I £ 


A = 


i 
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1 

2 




I- 


1 8 




V ^ 

\ 3 


1 
4 






Vi 8 



where | < 6^ < 1 for all j = 1,2,3. It is easy to show that A and B 
satisfy the condition (|2.ip . But the condition (|3.3p is not satisfied for A. 
Moreover, the system of inequalities Ac < Ic has many non-zero solutions. 
More precisely the complete set of solutions is 

f 11 16 2 4 

C = <^ c = (ci,c 2 ,c 3 ) : ci > 0, c 2 > — ci, — c\ + -c 2 < c 3 < 2c 2 - -ci 

It also can be observed that there is no nonzero solution for the system of 
inequalities Be < Ic. 



4. U-LIMIT SET OF SQSO 

For ([23D we have u(x°) = {(a n b n , a lm b lm )}, Vx° G S™^ 1 . But for 
(|2.4p the set a;(x ) depends on x° and on the properties of the matrix A. 
The set u(x°) can contain a single point (ergodic case, see [15], page 118), 
it can be a finite set (non-ergodic or periodic case, see page 121 of [15]). 

In this section using the Lyapunov functions described in the previous 
section we shall give upper estimation of to(x°) for SQSO (12.5j) . Denote 

C = {c e R m : Ci > 0, ci + ... + c m > 0, Ac < Ic or 5c < Ic}. 
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Then by Theorem 13.21 we have that ip c is a Lyapunov function for any c £ C. 
That is for any initial point x° E S m ~ 1 we have 

(4.1) lim Mx (n) ) = A c (x°), ceC. 

Thus lu(x°) c{i£ S"™ -1 : ip c (x) = A c (x )} for any c £ C which implies 

(4.2) u(x°) C P| {x £ S™" 1 : ^ c (x) = A c (x )} . 

cec 

The estimation f|4. 2j) is very useful: assume that there are m distinct vectors 
c^ 1 ), c^" 1 ) € C such that det(C) ^ where C is the mxm matrix with rows 
cW, z = l,...,m. Then system of equations tp c (i)(x) = A c (;)(x°), z = 1, ...,m 
has unique solution x = x* which by (|4.2p gives that lo(x°) = {x*}. If there 
is no any collection c®, 2 = l,...,m with det(C) ^ 0, then RHS of (|4.2p 
is a uncountable set. Note that RHS of (|4,2p can not be empty set since 
uj(x°) ^ 0, because {a; (n) }™ C S" 11 " 1 and 5 m_1 is a compact set. 



5. Discussions 

As it was mentioned in the Introduction, Pij : k is the probability that 
individuals in the ith and jth species interbreed to produce an individual 
k. Our assumption (jl.6p means that the parents ij independently partic- 
ipate for producing k. Under this condition the QSO became a product 
of two linear operators. Note that Volterra QSO ([5]) also is product of 
two linear operators: identical operator and a linear operator. The theory 
of the Volterra QSOs is developed enough. But our SQSO corresponding 
to quadratic matrices A and B coincides with Volterra QSO iff A or B is 
the identical matrix. Thus one can expect that SQSOs may have differ- 
ent dynamical behavior. We already have seen that SQSOs (for example, 
(|2.4p ) may have periodic trajectories this is quite different behavior from 
the behavior of the Volterra QSO, since Volterra operators have no periodic 
trajectories. We described a wide family of linear Lyapunov functions for 
SQSOs, but for Volterra QSOs, such a family of functions is not described, 
except ip(x) = Yli=i x i which is constructed in [5] under some conditions on 
parameters of (II. 5D . by using theory of tournaments. We think our argument 
also works for Volterra QSOs to describe linear Lyapunov functions. 

We know that A c (x°) given in (14. ip exists, but, in general, we don't know 
how to compute them. The following interesting problems are also open: 
Is there any other kind of Lyapunov functions of SQSOs? Develop a tour- 
nament theory approach for SQSOs (12. 5p . Here one may define two tour- 
naments corresponding to quadratic matrices A and B. Then properties of 
(12. 5p will depend on both tournaments. Also very interesting problem is to 
study connection between these tournaments. 
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